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Alexandria, VA 22313-1450, on the date below; 
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DECLARATION OF YASEEN SAMARA UNDER 37 C.F.R. § 1.131 
I, Yaseen Samara, hereby declare as follows: 



1. I am a co-inventor of record for the invention disclosed and claimed in the 
above-identified patent application. 

2. T am currently employed by GE Healthcare, a division of General Electric 
Company ("GE"), in the Imaging Solutions Group as a Systems Engineer. 

3. My business address is 2041A Lincoln Street, Berkeley, California 94709. 

4. I, along with the other co-inventors of record, conceived of the subject matter 
disclosed and claimed in the above-referenced application prior to September 23, 2003. This 
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conception is evidenced by an invention disclosure document that was prepared by one or more 

of either myself or the co-inventors of record and submitted to GE in the ordinary course of 
business prior to September 23, 2003. A true and correct redacted copy of pages 1-7 of this 
disclosure document is attached hereto as Exhibit A. 

5. Prior to September 23, 2003, 1 received e-mail conraiunications from outside 
counsel and Mr. Prakash Mathew, a co-inventor of record, discussing the scheduling of a 
telephonic interview to discuss the disclosure document (Exhibit A). This telephonic interview 
was carried out between outside counsel and at least one co-inventor, including Mr. Mathew, 
and is acknowledged by a true and correct redacted copy of the e-mail correspondence attached 
hereto as Exhibit B. 

6. Following the above-referenced telephonic interview, I received a copy of an e- 

mail communication on August 14, 2003 addressed to outside counsel from Mr. Mathew 
inquiring about the status of the preparation of the above-identified application. A true and 
correct redacted copy of this correspondence is attached hereto as Exhibit C. 

7. The above-referenced disclosure document (Exhibit A) and the above referenced 

interview (Exhibit B) clearly indicate that 1 and the co-inventors of record conceived of the 
invention ultimately disclosed and claimed in the above-identified application and were in fact in 
possession of the invention at least as early as August 14, 2003. 

8. On August 19, 2003, 1 received an e-mail communication from outside counsel, 
in which I was informed that a draft of the above-identified application had not been completed 
yet, but that outside counsel would complete the draft as soon as possible. This communication 
can be found in Exhibit C. 

9. On November 15, 2003, 1 received an e-mail communication from outside 
counsel having attached therewith an initial draft of the above-identified application and 
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corresponding Assignment md Declsdration papers. The e-mail commimicatkm requested 
that f review an initial compieled draft of the ahove-idcnlificii application for 
cooipI^enesB md Jivt m \c\ i.id «jxecttte Asstpmeixt «aid Dcicterations papers. A mt md 
corrsxt mtectwl copy of relevant pcirtiora of tihis com^pondaice is attaeiwd Iwcto q& 
EjthitsitD. 



application, I reviewed the above-idtntilltd application and executed the Assigiuiu tn -tr-u 

jDedaratMHi jmpers, {Tie executed Assignmeat and Deciaraiiou p^>ere were retwiied to 
outside counsel on. or before Nowmber 26, 2003. Constmctive redaction to praitice of 
the immtim. dfeclosed aid dmmsd m the above-idmtJfied application occurred m 
November 26, 2003. 

11. .Diligent efl<H^' m - September 23. 2003 through the 

filiag of ttic present patetil «p,^lKaMcn .-M ,w.^ciihoi 't^ 00^. 

J. 2. ITie sutojcsrt ^fflatter d^jiosed and daimed in tite abo^e-refaneaced 
appiicatscm was mwMved wWk in the United St@*es, 

I d^laaoe fiBttor tte all. statesmtg ma^ h«a«itt ajne of my own knowledge, ^are true 
«snd Oiat all ^ateErots midte m irrformaiioti ami belief are believed to be true, and fttrtiaef . 
tfcif tltcsp MiitCTTi.^nt^ wefx. made with the kmwledge tha^ wii!f«! fal.se statements and Hit, 
Hi. s. ...» . e 'n l-iSL i.i ,in[Hw» >n) ... !X ■ . i . i m tnJ 

tluit sttcfi wiiJiui uiivL. sLiieraenls may jeopardize the validil\ of the applicjlton. an) p;itent 
i.«ung theieoao^, oar any fMftent to wHcii &is varii.ed stiteMSt is dim:tadL 



cnihcr 26. 2CMI3, the fil:nu date ofsl.c .ibm t-iJeuiiiK- 1 



Dated: 



By: 




Yas^tt Samara 
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EXHIBIT A 



} 



Q" Invention Disclosure Form 


Docket No.; 133276 


Mail to: PATENT OPERATION, W-710 











Use as many pages in this word document as necessary. 

You may attach additional materials to support this disclosure, for example, Tech Notes and Drawings. 
Such submitted materials must be referenced in this disclosure form. Each page of these materials 
must be dated, signed and witnessed in the same manner as this invention disclosure. 




Method and system for de-identifymg burned m patient data from radiological images 

PRbSBfeM/BACkGRbXIND iJ Oescrib,e the vrobJ^gMkksoIvMd.by the, invention. . Assume that the reader has" a basic 
knmMWg^fJlc^mti^mst:o>imagimmodali^^^ . ' T 

Privacy laws within the medical practice are starting to be heavily enforced (if not already) and a number of regulatory laws 
mandate the restricted and appropriate disclosure of patient information in all medical records. Radiologists routinely need to, 
and have been transferring images to referring physicians and colleagues for consultation or teaching, as part of their 
workflow. Radiological images often contain patient identifying data (mainly text), which would allow a casual or informed 
observer to associate the image with an individual. Rather than change their established workflow, radiologists look to 
information system vendors such as GE to provide the tools to de-identify images of patient data to render them compliant to 
the regulatory law. 

Sometimes, the textual annotations are separate layers or tags within an imaging protocol such as DICOM. In such cases, 
suppressing the display of these tags alone, based on some coded set of rules would be a solution. This however is easy to do 
and intuitive. A bigger problem arises when the textual information identifying the patient is part of the image pixel set itself, 
i.e. it has been burned in. In such a case the de-identification problem for radiological images is not trivial and the solution of 
this would be a considerable benefit to the radiological community. 
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TN\^ENTION DESCRIPTION: Describe hoyvthe^ (nyeniiM-works and how it-sqlyes rhe problem posed above. 

As described earlier, the problem is that of automatically and conveniently de-identifymg "burned in" patient information 

from radiological images. 

Lets clarify what this invention will address. . . 

The most common radiological image interchange method is using the DICOM protocol format. The image is stored and 
transported in the form of an electronic file. There could be patient identifying information in: 

A) The DICOM headers: This is a text portion of the file that encapsulates some metadata regarding the image. Not all 
information will be visible in the displayed image, but it still represents data that could potentially reveal the identity 
of the patient. The d e-identification method is programmatically coding which information tags will be deleted or 
retained in an image.J 



B) The DICOM overlay tags: These are also structured information that could be bitmaps that are laid over the actual 
image. They capture annotations, markers to regions of interests etc. | 



C) The image pixel data. This is the actual pixel data with diagnostic infoiTnation content. For convenience and record- 
keeping, patient identifying mformation is often burned into the exposure. This kind of patient data is hard to 
programmatically remove beca use there is no structured way of removing this data . The invention addresses this 
binned data (}e-identification.^^^^^^^H|||||||||^^mi|||||||^^mi|||^^| 



The solution we propose will be the novel use of Optical Character Recognition (OCR) technology for the de-identification 
of radiological images. OCR technology itself is not new or novel and is quite a mature area. This is routinely and heavily 
used in the area of text scanning applications. The following is an excerpt from a casual search on the www.About.com 
website for the term Optical Character Recognition. 

OCR (Optical Character Recognition) is the process of turning a picture of words (such as a scan of 
a typed letter) into an editable document that you can open and use in your desktop publishing 
software, word processor, or other text editor. Today's OCR packages contain sophisticated support 
for multiple languages, PDF and HTI^L output, and format retention. 



|has Page Formatter to better retain formatting of pages and recognization of 

spreadsheets, tables, and other elements. Convert to and from PDF format. The International Voice 
Read Back reads your text aloud and now recognizes over 100 languages. 
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Pages 



It retains page layout, allows output as Web pages, retains color In photos or graphics, and is 
Windows 2000 certified. This is a low-cost OCR option. 



A powerful, bu^urprisingl^nexpensive alternative to some of the better known (and expensive) 
OCR packages. It reads 52 languages, preserves the page formatting, can scan color and dark 
backgrounds, has batch processing, and has expert tools for analyzing complicated layouts. 



4^ 1 

P^Of^TH^^^^^^^^^^^H^^^HI^Hi' the Pro recommended for home use but 

is more advanced than the Home edition. Supports over 100 languages, has built-in spell-checker, 
handles PDF and HTML and retains document formatting. An under $100US OCR option. 



The Business Edition includes new and improved PDF Output, supports 56 languages, retains 

formatting, and outputs to HTML format. Includes scheduled batch processing for busy offices. i 

I 

The workflow involved might proceed something like this. 

1) A radiologist opens a study on a PACS system. He scans through the exams and selects one or more images for 
sending to another institution, lets say for example, teaching purposes. HIPAA mandates that patient demographic 
information should not be disclosed. 

2) The radiologist now selects the "De-identify including burned text" option in the PACS system. 



3) The PACS system now readies the images for sending out. It first negotiates the format of data it needs to send the 
images in. If DICOM, it creates a copy of the image file, removes the patient demographic information and any 
overlays in the header. If any other image format like GIF or JPEG, it deals only with the pixel data in the fde. 
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4) In either case, the pixel data is fed iato the OCR software program. This can be done progressively, in sections of 
the image, comprising a strip about 1cm x 5cm or some such small subset. Each section is quickly scanned and the 
OCR software determines if text is included in these regions. If text is found then an approximate position of the text 
character is returned. Instead of subsets of strips of the image, the entire image can be fed into the OCR software as 
well. 

5) The PACS system then creates an opaque mask and bums it into the pixels at the locations where text has been 
recognized. This intensity value of the opaque mask value can be pre programmed into the system. As long as the 
mask is a single intensity value, the character information underneath is blocked out. 

6) The modified image, wiUi the masks burnt in and obscuring the text is then chosen as the image to be sent to the 
external system. The mask can be patterned or with a distinguishable border so as to clearly communicate to the 
viewer that information is missing from that region. 



DRAWLNG ; Makd as accurate a sketch or coinputei ^sr..ra:ed figure.ofyour invention as you can and emoed it into 
attut.li H to thi<- t„n" h n^ed not a aruw.ng to scale, hut ^liou'd be compkle ei'oitsih h ^ro i ii/i. , ^ . .n,d 
wu Qhxady-Aii^yeiuitabkpMff&raphsi iketeke^saJmi^flowchm^oiftmsh^diflra^M^s, they ma^ bes, M^e^^ > 



An example of a radiological image with patient identifying information is shown below: The patient name is visible as text, 
along with other textual annotations. 




After the steps outlined in the invention occur, the resulting image could be modified to look like one of the following: 
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In both cases, the textual information is overlaid out by a burned in mask, thereby anonymizing the idcnuly of the patient 
involved. 

In a related embodiment of the invention, specific rules can be incorporated in the software to recognize and exclude certain 
useful text which do not identify a patient. Useful text is in the form of measurements or view descriptions such as the phrase 
"FRONT" on the original image. Using this form of intelligent de-identification we could produce images like the following 




In this case, helpful information is retained while ihe patient identifying information is selectively masked out. 
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Block Diagram indicating for automatic de-identification 




No de-identification 
required for strip 
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There may be some cases, which will no doubt challenge the capacity of the invention. It will be cases where 

1 . The text is formatted vertically instead of the usual left to right approach. 

To address this problem ,we would configure the OCR software to read in vertical directions as well. This can be 
configured in addition to the left to right recognition. The user can choose to configure this or not, but the invention 
allows for this case. 



Lines running through the text could obscure the text or it could have extremely poor quality. 
For example. 



\i)S VM-U.I'SOlH \m IWENTIONjj 

1 Automatic: I his de-identification is done without any manual intervention. 



<a?i', bo'm-m te{,^/fij.ul taim] fcg s'lonsti 



Flexibility: The de- identification can be carried out at or in any subset of the image space, based on a set of pre- 
determined rules. 

Depending on the OCR software package used, a number of language texts can be recognized and removed. 

Security: Regulatory and safety guidelines and rules requiring image de-identification of patient information will be 
satisfied. 
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EXHIBIT B 



From: Mathew, Prakash (MED) [IMCEAEX- 

_0=GE_OU=GEMSAM_CN=RECiPIENTS_CN^ 

To: Pat Yoder 

Cc: Samara, Yaseen (GE Healthcare) 
Subject: RE: tcon to discuss 133276 and 133277 



Hi Pat, 

Regarding docket application, 133276, here is an ex; 



It was a pleasure talking to you yesterday... 

Thanks 

__prakash 

Original Message 

From : Pat Yoder [mailto:|^MM^^^B] 
Sent: ^ 

To: Mathew, Prakash (MED); Samara, Yaseen (MED, GEMS-IT) 
Subject: RE: tcon to discuss 133276 and 133277 

Sounds great Prakash. I'll look over the disclosures and we can try to fit everything in the hour, 
time we can schedule more when we talk. 

Talk to you then! 



Original Message-- 

From : Mathew, Prakash (MED) 
Sent: ! 

To: 'Pat Yoder'; Samara, Yaseen (MED, GEMS-FT) 
Subject: RE: tcon to discuss 133276 and 133277 

How a bout 10:30-1 1:30 CST ? 
TCON BilfHilH ^6^265 10 

_prakash 

Original Message-- 

From ; Pat Yoder [mailto:| 

Sent: I 

To: Samara, Yaseen (MED, GEMS-IT); Mathew, Prakash (MED) 
Subject: RE: tcon to discuss 133276 and 133277 



Guys, 



We have a regular meeting from 11:30 to about 1:00 i 
(Prakash, you picked my one window on this one.) 



n Thursdays. Can we work around that? 



Thanks. 



Original Message 

From: Samai^jraseerUMED^E^ [mailto:HH|^^HHillH] 
Sent: ^^HlHHljHii^l 

To: Mathew, Prakash (MED); 'Pat Yoder' 
Subject: RE: tcon to discuss 133276 and 133277 



Sounds great! Thursday morning then. 

Original Message 

From: Mathew, Prakash (MED) 

Sent: f^BHIHlHHHH 

To: 'Pat Yoder"; Samara, Yaseen (MED, GEMS-IT) 
Subject: RE: tcon to discuss 133276 and 133277 



Pat, Yaseen, 

I apologize for nonjesponding earlier... 
How does Thu morning sound? 

How about ^^^^^^^^ 

1 1 :00 - 1 2:00 CST TCON ■■■■■i #672651 0 (I'm flexible on 

the tinne that nnorning) 



_prakash 



Original Message-- 

From: Pat Yoder rmailto:! 
Sent; I 

To: Mathew, Prakash (MED); Sannara, Yaseen (MED, GEMS-IT) 
Subject: tcon to discuss 133276 and 133277 



Guys, 

Any thoughts on this? I'm in all week, but probably need a couple hours 
advance notice before a tcon. 



Thanks I 



Pat 



Guys, 

As Yaseen and I discussed last week, we will be preparing patent 
applications on the referenced disclosures. I just returned from an extended 
trip and did review the disclosures during that time. I think the best way to 
proceed is through a telephone conference during which we can walk 
through the disclosures and I can flesh out points as needed to move along 
to the drafting stage. 

I will be in all week working on various projects. Could you please just let 
me know what works for you guys and I'll plan around that. I think we may 
need as much as a couple of hours to get through the material. One or both 
of you may with to participate, and I understand that Mathew will probably 
be the "point person" for these applications. 

Thanks, and I look forward to hearing from you. 



Pat 



Patrick S. Yoder 

Fletcher, Yoder & Van Someren 

Attorneys at Law 

7915 FM 1960 West, Suite 330 



Houston, Texas 77070 



tel: m^m^^mi 



CONFIDENTIALITY NOTE 

The documents accompanying this e-mail contains information from 
the law firm of Fletcher, Voder and Van Someren which is confidential 
or privileged. The information is intended to be for the use of the 
individual or entity named in this transmission. If you are not the 
intended recipient, be aware that any disclosure, copying, distribution 
or use of the contents of this e-mailed information is prohibited. If you 
have received this e-mail In error, please notify us by telephone 
immediately so that we can arrange for the retrieval of the original 
documents at no cost to you. 



EXHIBIT C 



- StrFng E-mait Redaicted - 




Subject: 




Sent: Tuesday, August 19, 2003 7:46 AM 
To: Mathew, Prakash (MED) 
Cc: Samara, Yaseen (MED, GEMS-IT) 
Subject: RE: Status of 133276 and 1332^77 ? 



I have these laid out, but just have not completed them yet. Realistically, this will bleed over to next month. I'm 
personally working on these and will complete them as soon as I can. Please do not hesitate to follow up, but this 
work is on my very short list for completion, 

Thanks, 



- — Original Message — ~ _ - 
From: Mathew, Prakash (MED)'(M||||H 

Sent: Thui^day, August 14, 2003 6:10 PM 
To: 'Pat Yoder* 

Cc: Samara, Yaseen (MED, GEMS-IT) 
Subject: Status of 133276 and 133277 ? 
Importance: High 



Hi Pat, 

Just wondering about the status of the drafts for these cases... 
Thanks, 
_prakash • 

Original Message- 

From: p 
Sent: ] 

To: Mathew, Praka sh ( MfeD); §am^ra, Yaseen {ME D, GEMS-IT) 
Subject:| * 




-Original Message 



EXHIBIT D 
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- St|"lng E-mail Redacted ■ 

PatYoder 

From: Mathew, Prakash (MED) fllllllHIIIIHIi 

Sent: Tuesday, December 02, 2003 12:26 PM 
To: PatYoder 

Cc: , Samara. Yaseen (MED, GEMS-IT) 

Subject: RE: (GE docket 133276ITand 133277IT; our file GEMS:0234 and GEMS: 023 5) 

Hi Pat, . 



Thanks, 
_prakash 



Original Mess age— 

From: Pat Yoder| 

Sent: Wednesday, Novemter 19, 2003 1:31 PM 
To: Samara, Yaseen (MED, GEMS-U); PatYoder; Mathew, Prakash (MED) 
Subject: RE: (GE docket 133276ITand 133277rTrour file GEMS:0234 and GEMS: 023 5) 



-Original Message 

From: Samara, Yaseen (MED, GEMS-IT) | 



Sent: Wednesday, November 19, 2003 12:16 PM 
To: 'Pat Yoder'; Mathew, Prakash (MED) 
Subject: (GE docket 133276rrand 133277rT; our fl 



: GEMS:0234 and GEMS:023 5) 



Pat, Prakash 



Original Message- 

From: Pat Yoder f 

Sent: Saturday, November 15, 2003 5:50 PM 
To: 'Mathew, Prakash (MED)' 
Cc: Samara, Yaseen (MED, GEMS-TT) 

Subject: draft patent application (GE docket 133276IT; our file GEMS:0234) 
Importance: High 

Prakash, 

As we discussed, we have proceeded to prepare a patent application for the referenced matter, 



O/O/OAfVO 
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relating to obfuscatlon of patient and other data from reconstructed Images. Please find attached a 
copy of the application for your review and for review by the other co-Inventors. Also attached are 
the Assignment and Declaration documents for review and signature by all inventors. I have also 
attached a .pdf file containing the drawings referred to In the ajD^llcation. Finally, I have attached a 
Notice regarding gur obligations to the Patent and Trademark Office whenever we file new patent 
applications. 

Please review the application for completeness and accuracy, and ask the other co-inventors to do 
the same. Please keep in mind the points brought out in the attached Notic e. Once you hav e 
reviewed the application, please call me with any questions or comments at. jRHHBMBHP If you 
find the application complete and accurate, please print, sign and date the Assignment and 
Declaration documents, and have the other co-inventors do the same (noting..that the Assignment 
should be notarized when each of you signs it). 

Once signed PLEASE FAX THE ASSIGNMENT AND DECLARATION DOCUMENTS TO ME AT 
^P^f (and retain a. copy for your records-and in case we need them resent).. I would also ask that 
you drop the documents In the mail to my office at the address betow. We can file faxed copies, but 
must retain originals. IF NECESSARY, THE VARIOUS INVENTORS MAY SIGN DIFFERENT PHYSICAL 
COPIES OF THE DOCUMENTS. I will need all such copies faxed and mailed back to me, however. 

plHBHBHHBBHHHHHHHHHHi Accordingly, I would like to receive the 
documents for filing by MONDAY, NOVEMBER 24, 2003, AT THE. UTEST. 

Ag3.'j/,g.^g"M,y9".,^gv^..3ny questions or concerns, please do not hesitate to call or email me. flHi 



Thanks again for your help and hbrd work. I look forward to your feedback. 
Pat . 



Patrick S. Yoder 

FLETCHER YODER 
Attorneys at Law 
7915 FM 1960 West,. Suite 3 
Houston, Texas 77070 



CONFIDENTIALITY NOTE 



The documents accompanying this e-mail contains infonnation from the law firm of Fletcher 
Yoder which is confidential or privileged. The information is intended to be for the use of the 
individual or entity named in this transmission. If you are not the intended recipient, be 
aware that any disclosure, copying, distribution or use of the contents of this e-mailed 
information is prohibited. If you have received this e-maii in error, please notify us by 
telephone immediately so that we can arrange for the retrieval of the original documents at 
no cost to you. 



